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(54) [MAGE PROCESSING UNIT 

(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain the image 
processing unit in which high quality and adaptive color 
processing is attained by providing a correction means 
conducting color balance correction taking notice of 
balance of a specific color area where color unbalance is 
remarkable. 

SOLUTION: At first a reference color for color balance 
adjustment with respect to an image is set by a 
reference color setting section 101. A color by which 
color unbalance is easily remarkable is adopted for the 
reference color. Then a color extract section 102 
extracts colors in the vicinity of the reference color 
from color image data BGR received by a preliminary 
scanning of a scanner or the like and a representative 
value arithmetic section 103 sets a representative color 
from the extracted color and a condition setting section 
104 sets a correction condition of an image to a 
correction section 105 as to each color based on the 
reference color and the representative color. Thus, color 

image data RGB received by main scanning are subject to correction processing in response to 
a feature of an original image and adaptive image processing with high quality is attained. 
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CLAIMS 
[Claim(s)] 

[Claim 1] An image processing system characterized by providing the following. A criteria color setting 
means to set up a criteria color A representation color operation means to compute a representation color 
of the color by extracting said criteria color and nearby color from inputted image data A conditioning 
means to set up conditions of amendment which should be performed to inputted image data based on 
said criteria color and said representation color An amendment means to perform amendment according 
to set up conditions to image data into which it was inputted 

[Claim 2] Said conditioning means is the image processing system of claim 1 characterized by setting up 
conditions which bring said representation color close to said criteria color. 

[Claim 3] Said conditioning means is the image processing system of claim 1 characterized by setting up 
conditions which bring each primary color gradation of said representation color close to each primary 
color gradation of said criteria color, respectively. 

[Claim 4] Said amendment means is the image processing system of claim 1 characterized by applying 
conditions set up by said conditioning means to the whole image data into which it was inputted. 
[Claim 5] Said conditioning means is the image processing system of claim 1 characterized by setting up 
conditions which bring each primary color ratio of said representation color close to each primary color 
ratio of said criteria color. 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to the image processing system 
which performs amendment processing of a color-balance according to the property that the image of a 
processing object has a color picture especially about the image processing system reproduced in high 
quality. 
[0002] 

[Description of the Prior Art] In recent years, the advance and the spread of the image processing systems 
which process digital images, such as facsimile, and a digital copier, an image scanner, printers, those 
interfaces, are remarkable. In connection with this, a higher thing is increasingly called for also about the 
image quality which an image processing system offers. For example, about the digital copier, the point 
which reproduces the most faithful possible image (copy) to a manuscript was searched for by the former. 
However, when the manuscript itself is the thing of low quality, it is more desirable to perform signal 
processing of a digital no one but, to amend a subject-copy image appropriately and to output it rather, 
rather than reproducing a manuscript faithfully. The processing make it easy to emphasize the processing, 
alphabetic character, and line which give good contrast for example, by gradation amendment, and to 
read is mentioned to suitable amendment here. 

[0003] Moreover, various interfaces are connected to a digital copier and it may be used as a printer as 
facsimile. For example, in using as facsimile, generally there is no subject-copy image which should be 
compared with an output image at hand. Moreover, since the image displayed on the monitor is outputted 
as an electronic file when using as a printer, it is very difficult to obtain the printing image which is in 
agreement with the quality of a display image. On the other hand, to these images, the property of an 
image is detected and a reappearance image with more desirable performing processing of noise rejection, 
range conversion, etc. accommodative according to the property is obtained. 

[0004] Contrast, saturation, exposure, sharpness, etc. have the item set as some amendment objects, and 
such an image processing has the image processing which corrects a tint and color balance into them. As 
technology which corrects conventional tint and color balance, what makes the automatic correction of the 
color balance of an image is widely known, for example by unifying the range paying attention to the 
distribution condition of RGB each chrominance signal. 
[0005] 

[Problem(s) to be Solved by the Invention] However, in a system, there were the following troubles 



conventionally which was mentioned above. In having dynamic ranges with the enough image which 
serves as [ 1st ] a processing object first, there is a problem that the correction effect is hard to be acquired. 
For example, even if it is the image with which color balance has collapsed for appearance, each primary 
color by saturation of the case where it is migrating to the range where the distribution is large from 
bright gradation to dark gradation, a noise (it mainly generates in the case of an image input), or 
gradation etc. Since sufficient amendment processing is not performed to the image concerned when 
detected as distribution of each primary color being large enough, the effect by it is not acquired. The 
colors as which a gap of a color-balance is detected [ 2nd ] most greatly are colors which people memorize 
like, such as peopled skin, and empty blue, green of trees, a color to which an observer makes it known 
how for there to be any color of an image. Therefore, a good processing result is not necessarily obtained 
directly [ those colors ] in an epilogue and the place which amended a range based on the characteristic 
quantity which is not. 

[0006] The place which this invention was made in view of the problem mentioned above, and is made 
into the purpose is to perform color-balance amendment which paid its attention to the balance of the 
specific color field in which a gap of color balance tends to be conspicuous, and offer the image processing 
system in which quality accommodative color processing is possible. 
[0007] 

[Means for Solving the Problem] A criteria color setting means by which this invention sets up a criteria 
color in order to solve a problem mentioned above, With said criteria color, a color of predetermined 
within the limits is extracted from inputted image data. A conditioning means to set up conditions of 
amendment which should be performed to inputted image data based on a representation color operation 
means to compute a representation color of the color, and said criteria color and said representation color, 
It is characterized by providing an amendment means to perform amendment according to set-up 
conditions to image data into which it was inputted. Setting up beforehand a criteria color which serves 
as criteria of amendment according to this invention, from inputted image data, a criteria color extracts a 
color of predetermined within the limits, and performs amendment by which a representation color in an 
extracted color is computed and a representation color brings it close to a criteria color to inputted image 
data, for example. It becomes possible to obtain an output which does not have a gap of a color to a 
subject-copy image here by setting up a criteria color with a color to which a gap of color balance becomes 
remarkable. 
[0008] 

[Embodiment of the Invention] Hereafter, the operation gestalt by this invention is explained with 
reference to a drawing. Drawing 1 is the block diagram showing the configuration of the image processing 
system concerning the 1st operation gestalt by this invention. This image processing system is a system 
which performs automatic image amendment based on the property of that image, and generates the 
amended red (RO, green (GO, and the blue (BO signal to the color picture expressed with the digital signal 
of (Red R), green (G), and blue (B). In drawing 1 , 101 is the criteria color setting section and sets up the 
color used as the criteria of image amendment. 102 is the color extract section and extracts the color near 
the set up criteria color from the color picture data which is beforehand performed before this scan and 
which is beforehand supplied by scan in the scanner which is not illustrated. 103 is central value 
operation part and calculates the value (central value) of the color (representation color) which serves as 
the representation out of the color extracted in the color extract section 102 by the operation. 104 is the 



conditioning section and sets up the amendment conditions of an image based on the central value 
computed by the central value operation part 103 and the criteria color set up in the criteria color setting 
section 101. 105 is the amendment section and performs amendment processing to the color picture data 
supplied in this scan according to the amendment conditions set up in the conditioning section 104. 
[0009] Next, it explains that the image processing in the image processing system of a configuration of 
having mentioned above flows. In this image processing system, accommodative color balance adjustment 
processing is performed by performing reading of a color picture in 2 steps of a scan and this scan 
beforehand. That is, in this image processing system, first, out of the 1st color picture beforehand 
supplied by the scan, the near color of the color set up in said criteria color setting section 101 is extracted, 
and the amendment conditions on which the property of that image was based are set up. And color tone 
ready processing of the amendment conditions beforehand set up by the scan is performed to the color 
picture supplied by this 2nd following scan. 

[0010] Hereafter, the details of this actuation are explained. In this image processing system, the color 
which serves as criteria of color-balance adjustment over an image in the criteria color setting section 101 
is set up first. In drawing 2 , it is the criteria color to which the point (r, g, b) was set in the criteria color 
setting section 101. The color which serves as criteria here is a color in which gap of the balance of 
memory colors, such as people's skin and empty blue, and the color of a highlights gray field etc. tends to 
be conspicuous. 

[0011] Next, a scan is performed beforehand and the data of the color picture in that case is supplied to 
the color extract section 102. In the color extract section 102, the color contained in the range of the near 
field (r**deltar, g**deltag, b**deltab) of the criteria color set up by the criteria color setting section 101 is 
extracted. The rectangular parallelepiped field shown with the slash in drawing 2 is a field near the 
criteria color defined by (r**deltar, g**deltag, b**deltab). 

[0012] As mentioned above, the central value operation part 103 sets up the central value of the extracted 
color, and sets up the average (rave, gave, bave) of the color extracted in the color extract section 102 as 
central value. In addition, central value may be a median of the color which does not restrict to the 
average and was extracted etc. Based on the central value (rave, gave, bave) of the criteria color (r, g, b) 
set up in the criteria color setting section 101, and the color obtained by the central value operation part 
103, the conditioning section 104 creates LUT (look-up table) of a single dimension about each of each 
color, and sets up the amendment conditions of an image to the amendment section 105. 
[0013] Here, the details of the amendment conditions of an image are explained. Drawing 3 (a) shows the 
physical relationship of a criteria color (r, g, b) and the representation color (rave, gave, bave) extracted 
from the subject-copy image as the near color. In this relation, about the representation color (rave, gave, 
bave) of the inputted color picture, the amendment conditions set up in the conditioning section 104 are 
made into a criteria color (r, g, b), and only the part according to the difference of the color and a 
representation color concerned brings [ color / near the representation color ] them close to a criteria color. 
In this case, an example of the input-output behavioral characteristics of LUT created is shown in 
drawing 3 (b). In addition, although the input-output behavioral characteristics of each color are made 
into the polygonal line which makes the coordinate from which an output serves as a criteria color (r, g, b) 
top-most vertices in this example when an input is a representation color (rave, gave, bave) Especially 
this property is not restricted to this and an input is a representation color tit rave(s)). When it is gave 
and bave, it is the curve approximated with the polynomial, the spline function, etc., and it cannot be 



overemphasized that it is also possible to use the curve which passes this coordinate or the near 
coordinate. 

[0014] If the conditions of amendment are beforehand set up in a scan, this scan will be performed next. 
In this scan, gradation amendment is performed with reference to LUT about the data of the color picture 
supplied by that cause according to the input-output behavioral characteristics to BGR each color as 
shown in drawing 3 (b). Since amendment processing according to the feature of a subject-copy image is 
performed by such processing based on the set up criteria color, quality accommodative color processing is 
attained. 

[0015] Next, the image processing system of the 2nd operation gestalt by this invention is explained. In 
the image processing system concerning this operation gestalt, amendment of lightness and a range is 
also carried out to compensate for color-balance amendment. Drawing 4 is the block diagram showing the 
configuration of this image processing system. In this drawing, 401 is an image memory and stores the 
image data to which color-balance amendment is performed. 402 is a monitor and displays the image 
stored in an image memory 401 through the video interface 403. 404 is a data base and has memorized a 
reference image, color data, etc. which are used for color adjustment. 405 is the input section, consists of a 
keyboard, a pointing device, etc. and performs the input and setup of the information needed through I/O 
controller 406. 407 is the image editorial department, is constituted by image -analysis section 407a and 
image-processing section 407b, and performs processing according to the information into which the 
image data stored in the image memory 401 is inputted by the input section 405. 408 is an internal bus 
and the data between each above-mentioned component, an instruction, etc. are transmitted. 
[0016] Next, it explains that the image processing in the image processing system of a configuration of 
having mentioned above flows. Drawing 5 is a flow chart which shows actuation of the image processing 
system concerning this operation gestalt. In this image processing system, first, in step S501, it is the 
RGB image data stored in the image memory 401, and it is loaded to image-processing section 407b, and 
after the image data which is the object of processing is changed into what is made into the L*HC space of 
lightness, a hue, and saturation, it is re-stored in an image memory 401. If the color space conversion 
processing performed here is explained with reference to drawing 6 (a), approximation conversion will be 
carried out by the operation part 602 which performs the matrix operation type shown in drawing in 
L*a*b* space, among these the conversion to the spherical coordinate system of HC from a rectangular 
coordinate system will be made for a*b* by reference of two-dimensional LUT603, and the RGB image 
data of an image memory 401 will be changed into the image data of L*HC space, after gamma conversion 
is carried out by reference of l dimensional LUT601. 

[0017] Lightness amendment which adjusts the overall brightness of an image to drawing 5 to lightness 
L* in the following step S502 after the space conversion in return and step S501 again is performed. Here, 
lightness amendment is explained. In this lightness amendment, image analysis section 407a (refer to 
drawing 4 ) determines first whether to generate the histogram of lightness L* as shown in drawing 7 (a) - 
(d), and perform lightness amendment. This decision is further made as compared with the minimum 
value of histogram distribution, and the umbra threshold LI by comparing with the maximum of an 
isomerism cloth, and the bright section threshold L2. It determines not to amend, since the lightness of 
an image is covering the whole widely, if the minimum value of histogram distribution is smaller than the 
umbra threshold Ll and the maximum of an isomerism cloth is larger than the bright section threshold 
L2 as shown in drawing 7 (a) as a result of this comparison. Moreover, if the minimum value of histogram 



distribution is smaller than the umbra threshold Ll and the maximum of an isomerism cloth also has it, 
as shown in drawing 7 (b), since it inclines in the direction where the lightness of an image is dark, it 
determines to amend the direction made bright. [ smaller than the bright section threshold L2 ] On the 
other hand, if the minimum value of histogram distribution is larger than the umbra threshold Ll and 
the maximum of an isomerism cloth also has it, as shown in drawing 7 (c), since it inclines in the direction 
where the lightness of an image is bright, it determines to amend the direction made dark. [ larger than 
the bright section threshold L2 ] And since it has lightness with the moderate lightness of an image if the 
maximum of an isomerism cloth is smaller than the bright section threshold L2 and the minimum value 
of histogram distribution kicks more greatly than the umbra threshold Ll as shown in drawing 7 (d), it 
determines not to amend. When it is determined that image -analysis section 407a will amend, 
image-processing section 407b performs lightness amendment by the operation of L*out=L*ingamma. 
Here, gamma is a lightness amendment parameter which is set to gamma< 1, and is set to gamma> 1 in 
making it dark, when it is determined from the bias of distribution of L* and amends brightly. By such 
processing, lightness amendment is performed and a processing image is saved to an image memory 401. 
[0018] In the following step S503, range amendment is performed to drawing 5 to lightness L* after the 
image judging / lightness amendment in return and step S502. This amendment improves contrast by 
expanding distribution of lightness L* to the limit of that quantization range. If this range amendment is 
explained, like lightness amendment, first, image -analysis section 407a will generate the histogram of 
lightness L*, and will detect the highlights and the representation point of a shadow, respectively. 
Detection of a representation point is performed by detecting the point which shows 5% of the whole 
frequency from the maximum bright section and the maximum umbra. Then, image-processing section 
407b performs range amendment by the operation of L*out=alphaL*in+beta. Here, alpha and beta are 
range amendment parameters, respectively, and are both determined from highlights and the 
representation point of a shadow. By such processing, range amendment is performed and the processed 
image is saved in an image memory 401. 

[0019] Next, in step S504, color-balance amendment conditions are set up to the image with which 
lightness amendment and range amendment were performed. In the amendment conditioning of this 
color-balance, the color which serves as [ 1st ] criteria of color-balance adjustment over an image first is 
set up by the input section 405. Under the present circumstances, a criteria color may specify a specific 
color out of the color data memorized by the data base 404, and may specify it by choosing the specific 
region of the reference image similarly memorized by the data base 404. The criteria color specified here 
is calculated and changed at the value Q, h, c) belonging to the same L*HC space as image data. Next, in 
image-analysis section 407a, the color contained in the range of the near field (l**deltal, h**deltah, 
c**deltac) of a criteria color like the 1st operation gestalt is extracted by the 2nd, and the average Gave, 
have, cave) is set as it as central value. 

[0020] By the way, actual color-balance amendment is performed not in L*HC space but in the color space 
of RGB. then, the method of mentioning later the criteria color (1, h, c) and central value (lave, have, cave) 
with which image-processing section 407b was set as the 3rd by the input section 405, respectively - the 
value (r, g, b) in a RGB color space - and (rave, gave, bave) it changes. Then, image-analysis section 407a 
asks the 4th for the maximum Maxbase of the criteria colors (r, g, b), and the maximum Maxave of the 
central value (rave, gave, bave), respectively. Namely, Maxbase=Max (r, g, b), Maxave =Max (rave, gave, 
bave) 



It carries out. 

[0021] Then, image-analysis section 407a asks the 5th for the ratio (rateRbase, rateGbase, rateBbase) to 
the maximum Maxbase of a criteria color (r, g, b) by the operation of a degree type. That is, it asks by 
rateRbase=r/Maxbase, rateGbase=g/Maxbase, and rateBbase=b/Maxbase. 

[0022] And image -analysis section 407a is set as the 6th at a thing as shows the input-output behavioral 
characteristics of LUT referred to in the case of amendment to drawing 8 using the ratio for which it 
asked. That is, the input-output behavioral characteristics of LUT are set up so that it may become the 
polygonal line which makes the coordinate which sets an input to Maxave among the straight lines 
defined by each ratio top-most vertices. Thereby, each primary color ratio of a representation color is 
brought close to each primary color ratio of a criteria color. In addition, in the input-output behavioral 
characteristics shown in this drawing, it is set up in the following conditions. That is, these input-output 
behavioral characteristics are setup in the case of becoming Maxbase>Maxave, rave>gave>bave, and 
rateRbase>rateGbase>rateBbase. 

[0023] thus, the 1- if the amendment conditions of a color-balance are set up in the 6th, in the following 
step S505, it will reconvert the image data of a processing object in the color space of the RGB space 
which is the processing space. The L*HC image data memorized in the image memory 401 is loaded to 
image-processing section 407b, it is changed into RGB three-primary-colors space from the L*HC space of 
lightness, a hue, and saturation, and details restore it again here in an image memory 401. If the color 
space conversion processing performed here is explained with reference to drawing 6 (b), after the L*HC 
image data of an image memory 401 is changed into the rectangular coordinate system of a*b* from the 
spherical coordinate system of HC by referring to two-dimensional LUT604, approximation conversion is 
carried out by the operation part 605 which performs the matrix operation type shown in drawing in RGB 
space, further, gamma conversion will be carried out by I dimensional LUT606, and it will be changed 
into the image data of RGB space. 

[0024] And in step S506, image-processing section 407b performs amendment of the color-balance to the 
image data of the changed RGB space with reference to set-up LUT. By the above, a series of image 
amendment processings are completed. Thus, it becomes possible to amend only the balance of a color, 
with the thickness of the overall color which a subject-copy image has by saving the maximum of an input 
signal and amending each primary color component ratio held. Consequently, it becomes possible to 
amend a color-balance, without spoiling the effect of the lightness amendment and range amendment 
performed in advance of color-balance amendment. 

[0025] In addition, although the color-balance amendment in RGB space was indicated to be each 
operation ****** mentioned above, it is clear that this invention's it is not what is limited to it. Moreover, 
it is guessed easily that it is also possible to give two or more criteria colors to an image processing system, 
and to set up a correction curve. 
[0026] 

[Effect of the Invention] As explained above, according to this invention, the color-balance amendment 
which paid its attention to the balance of the specific color field in which a gap of color balance tends to be 
conspicuous is attained, and quality accommodative color processing is attained. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing ll It is the block diagram showing the configuration of the image processing system concerning 
the 1st operation gestalt of this invention. 

[Drawing 2l In this operation gestalt, it is drawing for explaining the concept of the physical relationship 
of a criteria color and its near field. 

[Drawing 3l (a) is drawing for explaining the concept of the physical relationship of a criteria color and a 
representation color, and (b) is drawing showing the input-output behavioral characteristics of LUT. 
fDrawing 4l It is the block diagram showing the configuration of the image processing system concerning 
the 2nd operation gestalt of this invention. 

[Drawing 51 It is the flow chart which shows actuation of the image processing system concerning this 
operation gestalt. 

[Drawing 61 (a) is the block diagram showing the configuration for performing color conversion to L*HC 
space from RGB space, and (b) is the block diagram showing the configuration for performing color 
conversion to RGB space from L*HC space. 

[Drawing 71 (a) - (d) is drawing showing the relation of the histogram of lightness and threshold in image 
data, respectively. 

fPrawing 8l It is drawing showing the input-output behavioral characteristics of LUT. 
[Description of Notations] 

101 [ .. The conditioning section (conditioning means), 105 / .. Amendment section (amendment 
means) ] .... The criteria color setting section (criteria color setting means), 102 The color extract section, 
103 Central value operation part (it is a representation color operation means by 102 and 103), 104 
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